L 

Number 


Hits 


Search Text 


DB 


Time stamp 


3 


3524 


(( (709/201) .CCLS.) or ( (709/238 ). CCLS . ) 


USPAT; 


2003/06/05 






or ( (709/248) .CCLS. ) or 


US-PGPUB; 


12 : 30 






( (709/105) .CCLS. ) ) or ( (709/242 ). CCLS . ) 


EPO; JPO; 








or ( (709/239) .CCLS. ) or 


DERWENT; 








( (709/240) .CCLS. ) or ( (709/241) . CCLS . ) 


IBM_TDB 








and ( ( (load adj balancing) or f ailover 










or (fault adj toleran$2) or 










f ault-toleran$2) with copy or replica) 






10 


3522 


( ( (709/201) .CCLS. ) or ( (709/238) .CCLS. ) 


USPAT; 


2003/06/05 






or ( (709/248) .CCLS. ) or 


US-PGPUB; 


14:36 






( (709/105) .CCLS . ) ) or ( (709/242) .CCLS. ) 


EPO; JPO; 








or ( (709/239) .CCLS. ) or 


DERWENT ; 








( (709/240) .CCLS.) or ( (709/241) .CCLS . ) 


IBM_TDB 








and (((load adj balancing) or failover 










or (fault adj toleran$2) or 










fault-toleran$2) with (copy or 










replica)) and (aad<20000628 






17 


3522 


(( (709/201) .CCLS.) or ( (709/238 ). CCLS . ) 


USPAT; 


2003/06/05 






or ( (709/248) .CCLS. ) or 


US-PGPUB; 


12 : 34 






( (709/105) .CCLS. ) ) or ( (709/242 ) .CCLS . ) 


EPO; JPO; 








or ( (709/239) .CCLS. ) or 


DERWENT; 








( (709/240) .CCLS. ) or ( (709/241) .CCLS. ) 


IBM_TDB 








and ( ( (load adj balancing) or failover 










or (fault adj toleran$2) or 










f ault-toleran$2) with (copy or 










replica) with (database or (routing adj 










table))) and @ad<20000628 






24 


1 


(( (709/201) -CCLS. ) or ( (709/238 ). CCLS . ) 


USPAT; 


2003/06/05 






or (( (709/248) .CCLS. ) or 


US-PGPUB; 


14 : 07 






( (709/105) .CCLS. ) ) or ( (709/242 ), CCLS . ) 


EPO; JPO; 








or ( (709/239) .CCLS. ) or 


DERWENT; 








( (709/240) .CCLS. ) or ( (709/241) .CCLS .) ) 


IBM_TDB 








and ( ( (load adj balancing) or failover 










or (fault adj toleran$2) or 










f ault-toleran$2 ) with (copy or 










replica) with (database or (routing adj 










table))) and @ad<20000628 






31 


16 


(( (709/201) .CCLS.) or ( (709/238) .CCLS. ) 


USPAT; 


2003/06/05 






or (( (709/248) .CCLS. ) or 


US-PGPUB; 


12 : 56 






( (709/105) .CCLS. ) ) or ( (709/242 ). CCLS . ) 


EPO; JPO; 








or ( (709/239) .CCLS. ) or 


DERWENT; 








( (709/240) .CCLS. ) or ( (709/241 ). CCLS .) ) 


IBM_TDB 








and (((load adj balancing) or failover 










or (fault adj toleran$2) or 










f ault-toleran$2) with (copy or 










replica) ) and @ad<20000628 






38 


3 


(((first or primary) adj server) same 


USPAT; 


2003/06/05 






((second or secondary) adj server) same 


US-PGPUB; 


13:00 






( (copy or replica) near2 database) ) and 


EPO; JPO; 








@ad<20000628 


DERWENT; 










IBM TDB 




45 


4 


(("6338092") or (" 6208952 ")). PN. 


USPAT; 


2003/06/05 








US-PGPUB; 


14 :08 








EPO; JPO; 










DERWENT; 










IBM TDB 




52 


552 


(370/351) .CCLS. 


USPAT; 


2003/06/05 








US-PGPUB; 


14:36 








EPO; JPO; 










DERWENT; 










IBM_TDB 






18 


"6181694" 


US PAT ; 


^UUo/ Ub/ U J 








US-PGPUB; 


08:53 








EPO; JPO; 










DERWENT; 










IBM TDB 
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- 


242 


(router or gateway) with ((plurality or 


USPAT; 


2003/05/28 






multiple) near2 (protocol)} 


US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


12 : 08 




131 


(router or gateway) with ((plurality or 


USPAT; 


2003/05/28 






multiple) near2 (protocol)) and 


US-PGPUB; 


12:50 






@ad<20000628 


EPO; JPO; 
DERWENT; 
IBM TDB 






1112 - 


(709/201) .CCLS. 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2003/05/28 
12:57 




1187 


(709/238) .CCLS. 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2003/05/28 
12:57 




371 


(709/248) .CCLS. 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT ; 
IBM TDB 


2003/05/28 
14:59 


- 


409 


(709/105) .CCLS. 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2003/05/28 
12:58 




2967 


( (709/201) .CCLS. ) or (( 709/238 ). CCLS . ) 


USPAT; 


2003/05/28 






or ( (709/248) .CCLS. ) or 


US-PGPUB; 


12:58 






( (709/105) .CCLS. ) 


EPO; JPO; 
DERWENT; 
IBM TDB 






262 


(709/242) .CCLS. 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2003/05/28 
13:12 




365 


(709/239) .CCLS. 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2003/05/28 
13:12 




156 


(709/240) .CCLS. 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2003/05/28 
13:12 




141 


(709/241) .CCLS. 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2003/05/28 
13:12 


- 


2 


route adj table adj manager 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT ; 
IBM TDB 


2003/05/28 
15 : 10 


- 


5 


(multi-processor or (multiple adj 


USPAT; 


2003/05/30 






processor) ) adj router 


US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


08:49 




1013 


(multi-processor$l or ((multiple or 


USPAT; 


2003/05/30 






plurality or number) near2 


US-PGPUB; 


09:10 






processor$l) ) with rout$3 


EPO; JPO; 
DERWENT; 
IBM TDB 
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- 


3591 


(( (709/201) .CCLS. ) or ( (709/238 ). CCLS . ) 


US PAT ; 


2003/06/05 






or ( (709/248) .CCLS. ) or 


US-PGPUB; 


12 : 27 






( (709/105) .CCLS. ) ) or ( (709/242) .CCLS. ) 


EPO; JPO; 








or ( (709/239) .CCLS. ) or 


DERWENT ; 








( (709/240) .CCLS. ) or ( (709/241) . CCLS . ) 


IBM_TDB 




- 


0 


( (multi-processor$l or ( (multiple or 


US PAT; 


2003/05/30 






plurality or number) near2 


US-PGPUB; 


08 : 53 






processor$l) ) with rout$3) and 


EPO; JPO; 








( ( ( (709/201) .CCLS. ) or 


DERWENT ; 








( (709/238) .CCLS. ) or ( (709/248) .CCLS. ) 


IBM_TDB 








or ( (709/105) .CCLS. ) ) or 










( (709/242) .CCLS. ) or ( (709/239) .CCLS. ) 










or ( (709/240) .CCLS. ) or 










( (709/241) .CCLS. ) ) and @ad<2000628 






- 


69 


( (multi-processor$l or ((multiple or 


US PAT; 


2003/05/30 






plurality or number) near2 


US-PGPUB; 


08 : 53 






processor$l) ) with rout$3) and 


EPO; JPO; 








( ( ( (709/201) .CCLS. ) or 


DERWENT ; 








( (709/238) .CCLS. ) or ( (709/248 ). CCLS . ) 


IBM_TDB 








or ( (709/105) .CCLS. ) ) or 










( (709/242) .CCLS. ) or ( (709/239) .CCLS. ) 










or ( (709/240) .CCLS. ) or 










( (709/241) .CCLS. ) ) and @ad<20000628 






- 


92 


(multi-processor$l or ( (multiple or 


US PAT ; 


Z UU J/ Uo / JU 






plurality or number) near2 


US-PGPUB; 


09:19 






processor$l) ) with (rout$3 or 


EPO; JPO; 








forward$3) same (register$3 or enroll$3 


DERWENT; 








or join$3 (sign$3 adj on) or (sign$3 


IBM_TDB 








adj up) ) 




2003/05/30 


- 


6 


( ( ( (709/201) -CCLS. ) or 


US PAT; 






( (709/238) .CCLS. ) or ( (709/248) .CCLS. ) 


US-PGPUB; 


09:54 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/242 ) .CCLS . ) or ( (709/239) . CCLS . ) 


DERWENT ; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) .CCLS. ) ) and 










( (multi-processor$l or ((multiple or 










plurality or number) near2 










processor$l) ) with (rout$3 or 










forward$3) same (register$3 or enroll$3 










or join$3 (sign$3 adj on) or (sign$3 










adj up) ) ) 




2003/05/30 


- 


21 


scalable adj router 


US PAT; 






US-PGPUB; 


09:55 








EPO; JPO; 










DERWENT; 










IBM TDB 




- 


5 


(scalable adj router) and @ad<20000628 


US PAT; 


2003/05/30 






US-PGPUB; 


10 : 00 








EPO; JPO; 










DERWENT ; 










IBM_TDB 




- 


3877 


( rout$3 with shar$3) and (aad<20000628 


US PAT; 


2003/05/30 






US-PGPUB; 


10:01 








EPO; JPO; 










DERWENT; 










IBM TDB 




- 


4 


"3" and (( rout$3 with shar$3) and 


US PAT; 


2003/05/30 






@ad<20000628) 


US-PGPUB; 


10 : 01 








EPO; JPO; 










DERWENT ; 










IBM_TDB 




- 


158 


( ( { (709/201) .CCLS. ) or 


US PAT; 


2003/05/30 






( (709/238) .CCLS. ) or ( (709/248) .CCLS. ) 


US-PGPUB; 


10 : 02 






or ( ( /uy/ lUb ) . CCLS , ) ) or 


■Ri pPi • TDO • 
iLrKJ f U i:\J f 








( (709/242) .CCLS. ) or ( (709/239) . CCLS . ) 


DERWENT ; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) .CCLS. ) ) and (( rout$3 with 










shar$3) and @ad<20000628 ) 
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- 


18 


( (multi-processor$l or ( {multiple or 


USPAT; 


2003/06/03 






plurality or nuinber) near2 


US-PGPUB; 


15 : 11 






processor$l) ) with rout$3) and 


EPO; JPO; 








( ( ( { (709/201) .CCLS. ) or 


DERWENT; 








( (709/238) .CCLS. ) or ( (709/24 8) .CCLS. ) 


IBM_TDB 








or ( (709/105) .CCLS. ) ) or 










( (709/242) . CCLS . ) or ( (709/239) . CCLS . ) 










or ( (709/240) .CCLS. ) or 










( (709/241) .CCLS. ) ) and (( rout$3 with 










shar$3) and @ad<20000628) ) 






- 


372 


(routing adj updat$3) or {((link adj 


USPAT; 


2003/06/02 






state) or link-state) adj 


US-PGPUB; 


10: 18 






adve r t i s emen t $ 1 ) 


EPO; JPO; 










DERWENT ; 










IBM_TDB 




- 


1 


( {multi-processor$l or ( (multiple or 


USPAT; 


2003/06/02 






plurality or number) near2 


US-PGPUB; 


16:06 






processor$l) ) with rout$3) and 


EPO; JPO; 








{routing adj protocol) and 


DERWENT; 








{ ( ( ( (709/201) .CCLS. ) or 


IBM_TDB 








( (709/238) .CCLS.) or ( (709/248) .CCLS. ) 










or ( (709/105) .CCLS. ) ) or 










{ (709/242) .CCLS. ) or ( (709/239) .CCLS. ) 










or ( (709/240) .CCLS. ) or 










( (709/241) .CCLS. ) ) and (( rout$3 with 










shar$3) and @ad<20000628 ) ) 






- 


21 


scalable adj router 


USPAT; 


2003/06/03 








US-PGPUB; 


08:56 








EPO; JPO; 










DERWENT; 










IBM TDB 




- 


5 


scalable adj router and (aad<20000628 


USPAT; 


2003/06/03 








US-PGPUB; 


08:56 








EPO; JPO; 










DERWENT; 










IBM TDB 




- 


9 


( (client with server) or client-server 


USPAT; 


2003/06/03 






or client/server) with regist$5 same 


US-PGPUB; 


17: 41 






((different adj protocol$l) or ((first 


EPO; JPO; 








or second) near2 protocol$l)) 


DERWENT; 










IBM TDB 




- 


8 


( (client with server) or client-server 


USPAT; 


2003/06/03 






or client/server) same regist$5 same 


US-PGPUB; 


13: 43 






( (different or multiple or plurality or 


EPO; JPO; 








(first or second) ) near2 protocol$l) 


DERWENT; 








and (shar$3 ) and @ad<20000628 


IBM_TDB 




- 


3515 


( ( (709/201) .CCLS. ) or ( (709/238) .CCLS. ) 


USPAT; 


2003/06/03 






or ( (709/248) .CCLS. ) or 


US-PGPUB; 


14 : 03 






( (709/105) .CCLS. ) ) or ( (709/242 ). CCLS . ) 


EPO; JPO; 








or ( (709/239) .CCLS. ) or 


DERWENT; 








( (709/240) .CCLS. ) or ( (709/241) .CCLS. ) 


IBM_TDB 


- 






and maintain$3 with distribut$3 with 










database and @a<20000628 ^ 






- 


3602 


(( (709/201) .CCLS. ) or ( (709/238 ). CCLS . ) 


USPAT; 


2003/06/03 






or ( (709/248) .CCLS. ) or 


US-PGPUB; 


14:03 






( (709/105) .CCLS. ) ) or ( (709/242 ). CCLS . ) 


EPO; JPO; 








or ( (709/239) .CCLS. ) or 


DERWENT; 








( (709/240) .CCLS. ) or ( (709/24 1 ). CCLS . ) 


IBM TDB 




- 


0 


( ( ( (709/201) .CCLS. ) or 


USPAT; 


2003/06/03 






( (709/238) .CCLS. ) or ( (709/248) .CCLS. ) 


US-PGPUB; 


14 : 04 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/2 42 ). CCLS . ) or ( (709/239) . CCLS . ) 


DERWENT ; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) .CCLS. ) ) and maintain$3 with 










distribut$3 with database and 










@a<20000628 
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- 


33 


( ( ( (709/201) .CCLS. ) or 


US PAT; 


2003/06/03 






( (709/238) .CCLS. ) or ( (709/248 ). CCLS . ) 


US-PGPUB; 


15 : 02 " 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/242) .CCLS. ) or ( (709/239) .CCLS . ) 


DERWENT; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) .CCLS. ) ) and maintain$3 with 










distribut$3 with database and 










@ad<20000628 






- 


2500 


( ( { (709/201) .CCLS. ) or 


US PAT; 


2003/06/03 






( (709/238) .CCLS. ) or ( (709/248 ). CCLS . ) 


US-PGPUB; 


15:03 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/242) .CCLS. ) or ( (709/239) . CCLS . ) 


DERWENT; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) .CCLS. ) ) and @ad<20000628 






- 


330 


( ( ( ( (709/201) .CCLS. ) or 


US PAT; 


2003/06/03 






( (709/238) .CCLS. ) or ( (709/248) .CCLS. ) 


US-PGPUB; 


15 : 12 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/242) .CCLS. ) or ( (709/239) . CCLS . ) 


DERWENT ; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) .CCLS. ) ) and @ad<20000628 ) 










and ( (client or processor) with 










register$3) 






- 


7 


( ( ( ( (709/201) .CCLS. ) or 


US PAT; 


2003/06/03 






( (709/238) .CCLS. ) or ( (709/248 ). CCLS . ) 


US-PGPUB; 


15 : 23 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/242) .CCLS. ) or ( (709/239) . CCLS . ) 


DERWENT; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) -CCLS. ) ) and @ad<20000628 ) 










and ( ( (client or processor) with 










register$3) same (rout$3 near2 










(database or table) ) ) 






- 


154 


( ( ( ( (709/201) .CCLS. ) or 


US PAT; 


2003/06/03 






( (709/238) .CCLS. ) or ( (709/248 ). CCLS . ) 


US-PGPUB; 


16:16 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/242) .CCLS. ) or ( (709/239) . CCLS . ) 


DERWENT; 








or ( (709/240) .CCLS, ) or 


IBM_TDB 








( (709/241) .CCLS. ) ) and @ad<20000628) 










and ( (client or processor) near2 










register$3) 






- 


8 


(((( (709/201) .CCLS. ) or 


US PAT; 


2003/06/03 






( (709/238) .CCLS. ) or ( (709/248 ). CCLS , ) 


US-PGPUB; 


15 : 26 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/242) .CCLS. ) or ( (709/239) .CCLS. ) 


DERWENT; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) .CCLS. ) ) and @ad<20000628) 










and ( ( (client or processor) near2 










register$3) same protocol$l) 






- 


1 


synchroniz$5 adj3 maintenanc$3 adj2 


US PAT; 


2003/06/03 






distribut$3 adj4 database 


US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


16: 18 


- 


1 


synchroniz$5 adj3 maintenanc$3 adj2 


US PAT; 


2003/06/03 






distribut$3 with database 


US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


16: 18 


- 


253 


synchroniz$5 with distribut$3 with 


US PAT; 


2003/06/03 






database 


US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


16: 18 


- 


24 


(((( (709/201) .CCLS. ) or 


US PAT; 


2003/06/03 






( (709/238) .CCLS. ) or ( (709/248 ). CCLS . ) 


US-PGPUB; 


16:19 






or ( (709/105) .CCLS. ) ) or 


EPO; JPO; 








( (709/242 ). CCLS . ) or ( (709/239) . CCLS . ) 


DERWENT ; 








or ( (709/240) .CCLS. ) or 


IBM_TDB 








( (709/241) -CCLS. ) ) and @ad<20000628) 










and (synchroniz$5 with distribut$3 with 










database) 
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- 


51 


regi3ter$3 nearS ( (different adj 


US PAT / 


2003/06/04 






protocol$l) or ((first or second) near2 


US-PGPUB; 


16: 47 






protocol$l) ) 


EPO; JPO; 










DERWENT ; 










IBM TDB 




- 


0 


(regi3ter$3 near3 ( (different adj 


USPAT; 


2003/06/04 






protocol$l) or ((first or second) near2 


US-PGPUB; 


16:06 






protocol$l ) ) ) and (emulation adj 


EPO; JPO; 








server) 


DERWENT; 










IBM TDB 




- 


2 


(register$3 near3 ( (different adj 


USPAT; 


2003/06/04 






protocol$l) or ( (first or second) near2 


US-PGPUB; 


16:06 






protocol$l) ) ) and (emulation ) 


EPO; JPO; 










DERWENT; 










IBM TDB 




- 


121 


register$3 with ( (different adj 


USPAT; 


2003/06/04 






protocol$l) or ( (first or second) near2 


US-PGPUB; 


16:44 






protocol$l)) and @ad<20000628 


EPO; JPO; 










DERWENT; 










IBM TDB 




- 


17374 


register$3 ad j 6 (client or processor) 


USPAT; 


2003/06/04 






and @ad<20000628 


US-PGPUB; 


16:47 








EPO; JPO; 










DERWENT ; 










IBM TDB 




- 


11 


register$3 ad j 6 (client or processor) 


USPAT; 


2003/06/04 






same ((different adj protocol$l) or 


US-PGPUB; 


17:04 






((first or second) near2 protocol$l) ) 


EPO; JPO; 








and @ad<20000628 


DERWENT; 










IBM_TDB 






2 


( "6338092" ) . PN. 


USPAT; 


2003/06/04 








US-PGPUB; 


17:04 








EPO; JPO; 










DERWENT; 










IBM TDB 
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[57] ABSTRACT 

A replication protocol which includes associating a database 
version vector with each copy of the database in the system 
is provided. Eadi database version vector keeps track of the 
total number of updates to any data items in its respective 
database replica and &om which server those updates were 
originally performed. During replication between two 
replicas, the database version vectors of the replicas are 
compared to efEiciently determine if update replication is 
necessary. J£ the database version vectors are not identicaL, 
the server possessing the more recent version of the data 
items propagates those data items to the server whose replica 
is older using conventional update propagation techniques. 
Identical database version vectors indicate that update 
propagation is not necessary. As such, the protocol avoids 
examining every data item in the database in order to 
determine the necessity of update propagation, which is 
required in conventional replication protocols. 
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MAINTAINING CONSISTENCY OF Systems, IEEE Trans, on Software Eng. 9(3) pp. 240-246 

DATABASE REPLICAS (May 1983), both herein incorporated by reference for all 

purposes. 

FIELD OF THE INVENTION: The periodic pair- wise comparison of version infcamation 

— " . ^ 1 * . J. ^-1. .J .5 introduces ovahcad. This ovediead increases linearly with 

The present inveaUon rdates to a distributed ^ocessing ^ the scalabiHty of 

systemand, morepamcularly to in^taimng consistency of epidemic protocols. A protocol for avoitog the unnecessary 
database rephcas within the distnbuted system. processing overhead associated with pair-wise comparison 

BACKGROUND OF THE INVEOTION f Jf^' ^^^P^',^, N^^^' 

w*xv*ixvw^v xwA^ vcrsioninformatxonof a data Item copy mcludes a sequence 

In distributed systems, access to data items is often number and modification time. The sequence number 

facilitated by database servers. A database server provides records the number of updates to the respective copy of the 

storage of data items grouped into databases. An application item; the modification time contains the time of the last 

running on a cKent station, such as a personal conqjuter, can modification of the corresponding data item copy. In 

access a data item by connecting to the database server that addition, each server records the time when it propagated 

steles the corresponding database. A common scenario updat^firomitsreplica toeveryother server. This is refen^^ 

associated with distributed systems is that some clients are ^^fi^^'Pf^^.?" ^^^f^. TV ^ 

geographicaUy located a great distance away from the database modification tm^ which is tiic tmie of the last 

Lv^?Xccess tothe database by these dientsis generaUy by ^^^^^^ ^^.T."^ ^'"^""'^ ''P^'"- 

remote connections, e.g., dial up connections. Remote con- ^ ^ scheduled rcphcation session bctw«:n sour^ 

nections can incur long distance charges wWdi result in f^l'^f^^^T/^uT: !l'r''T '^"^ ""^^^ 

added cost Also, remote connections tend to have less '^^/ij' ^^i'*^ ^^.Pl '"^^f j?"^ 

Z~r jIu v'li r *^ iiavt scheduled repUcaUon session between the two. Verification 

bandwidto capability thereby decreasing system peifor- comp^g the database modification time in the 

mance. To improve performance and reduce cost m distob- .^urce server with the last propagation time between the 

uted systen^,rephcas of the databaseare stored on mulfap^^ ^ ^^^^ ^^^^^^ ^ ^^^^^ modification 

servers, ^chadvantogeouslylocat^dinpr ^.^^ j^^^ ^^^^ j^^t propagation time, then no 

groups of chent^. -Replica, as used herem, refers to a copy data item has changed and the replication session tenninatcs. 

of a database. Sudi systems are known as replicated dis- otherwise, the source server examines each data item in its 

tnbutcd systems. However, the existence of more than one deteimine which of the data items has changed 

icplica of the database requires rephca management proto- 3^ repUcation session. Tliis is done by 

cols to ensure that the data m all database rephcas arc comparingthemodificationtimfiof each data item copy with 

consistent rq)lication time between the source and recipient 

In many conventional replicated systems, replica oonsis- servers. The source server compiles a list of the data items 

tcncy is achieved with the use of epidemic protocols such as that has been modified since the last update replication 

those described in Demcrs ct al.. Epidemic AlgorWans for 35 session and sends it to the recipient server. The entries in the 

RepUcated Database Maintenance, Proc. of 6th Symp. on list include the data item names and their sequence numbers. 

Principles of Etistr. Computing, p. 1-12 (1987); Ladin et aL, xhe recipient server compares the sequence numbers of die 

Providing High Availability Using Lazy ReplicaHon, ACM data items in the list with the sequence numbers of the same 

Trans, on Computing Systems, p. 360-391 (Novanber data items in its replica and copies those data items from the 

1992); and Guy et at, Implementation of the Ficus RepU- 40 source server which have the greater sequence number. 

"^^I'K^?'^^'^' ^^^"^ ^"'^ ^ The Lotus Notes protocol may detect in constant time if 
(1990), aU mcoiporated by reference for all purposes. Such propagation is not required, but only if no data item 
protocols perform user opo^ations, such as reads and ^ ^^^^^ ^een modified since tiie last 
updoes, on a smglerepUca. All updates are then prated propagation with the recipient However, in many cases, the 
to the other rephcas asynchronously during a scheduled 45 source and recipient database replicas will be identical even 
r^cation procedure In general, tiie repUcation procedure though Uie source database has been modified since the last 
between a s«ffce rephca and a recipient repUca involves 1) update propagation to the recipient For instance, after the 
dcteimimng if the source repUca contems updates th^ need last propagation between themselves, both nodes may have 
to be sent to the recipient server, and 2) propagation of those performed update propagation from other nodes and copied 
updates to the recipient server in order to maintain consis- 50 some data modified there. Or, the recipient database may 
tency b^een the repHcas. ^ obtained updates from the source indirecdy via inter- 
In epidemic protocols, the step for determining whether or mediate nodes, 
not update jsqpagaUon is necessary includes the pair-wise these cases, the Lotus Notes protocol incurs high 
comparison of version information of coiiesponding copies overhead for alienating update propagation between iden- 
of aU data items in the source and recipient repUcas. The 55 tical database rcpUcas. At flie Tninimi.Tn^ this overhead 
version information, which is associated with each copy of indudes comparing the modification time of every data Uem 
every data item, is used to identify more recent copies of source database against the time of the last update 
data items. For example, the version information may com- propagation. Thus, it grows linearly in tiie number of data 
pdsc the number of updates made to its respective copy of items in the database. Cleady from the above discussion, it 
the data item. The copy possesshig version information 60 js therefore desirable to provide a protocol that determines 
reflecting mOTc updates, in general, is the more recent cc^y whether repUcation is necessary between two repHcas witii- 
of the data item. Conventional techniques used to refaresent out incurring overhead associated witii examining all data 
version information include version numbers and version jtcms in cither the source and/or recipient database repHcas. 
vectors as described in Gifford, D.K., Weighted Voting For 

RepUcated Data, Proc. 7th ACM SIGOPS Symposram on 65 SUMMARY OF THE INVENTION 

Operating Principles, pp. 150-159 (1979) and Parker, D.S., The invention relates to a repHcatcd distributed system 

et aL, Detection of Mutual Inconsistency in Distributed comprising a plurality of servas and a plurality of database 
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replicas which comprises a plurality <^ data items. Far 1, a aunplificd illustratioD of a conventional rqdicated 

purposes of discussion, it is not important to distinguish distributed system 100 is shown. Sudi systems are described 

between ttie copies of the database replicas and the original in Berson, Client/Server ArMtecture, McGraw-HilL Inc^ 

database. As such, the term "database lepUcas" refers to both 1992, herein incorporated by reference for all purposes, 

the copies of the database as well as the original database. 5 Distributed system 100 comprises sites 110, 120, and 130 

The system includes at least n database repUcas carespond- netwotlced t<^ether by commnnication links iSOa-lSOc. 

tog to n servers, where n ls^2, and whereto each of the n Tte physical tagdementalion of the cominumcanon Imks is 

database replicas comprises at least x data items, wh=e x H"' >7«tant ""^^^ die communication Imks may 

jj^2 ^ * l^cal area network (LAN) or a wide area network 

~ ' . . „ (WAN) interconnecting sites at geographically dispersed 

In accordance to the invention, a protocol maintaining 10 j^^^ns. The sites may also be 'loosely connected". i.e., 

consistency among the x data items in the n replicas is connected through dial-up connections or wireless connec- 

provided. The protocol efficiently determines the necessity jions such as satellite links. 

of update propagation between any two of tf,e n servers. hG. 2 is an exemplary site 200 of the distributed system. 

Accordingto one embodiment, version mformation, su<* as site todudes a pluraUty of cUents 240fl-240c 

version vectors^ is associated with each copy of die x data 15 ^^^^ ^ ^ ^10 by a LAN, MAN, or WAN. Tlie 

'^.^r^'^^'iy^^r'^^'^ ?'"''^!- ''Tr cUents, for example, miy be personii computers, 

records the numb« rf updates made to its respecUve data ^«rksl^ons,ortenilals. Other cHe^ts (not shown) Wyte 

Item and on which of Ae n servers that the updates were ^^^^ ^ ^^^^ ^ ^ ^ ^ 

otiginaUypcrfoimciA^t.onaUy tteprotoro^ be associated with a particular site, it is understood that they 

database vcxsion vector for each of the n database replicas. 20 u_ .a.- *u * 

uato^oav T **v**i u mav coiincct to othet scTvcFS at othcT sitcs Within the SYStcm 

Ihedatabase version vector keeps track of the total ttumber „ ^„^i, ™ 

, ^ ^ t- J* J * • •* using remote iinks, such as dial-up connections using 

of updates that were applied to any of the x data items in its j . , ^ - *^ ^ lu*. i- 1 

, ^ vt.**!. modems, wireless connections such as satelhte links, or 

respecuve database replica which of the n servers ^ ^^^^^ Rtttheimore, it is understood 

each update was originally performed. ^ that dients may have similiir or different configurations from 

In one embodiment, the database version vector com- each other, and other cUents (not shown) may be included as 

prises at least n number of conq)onents, each corresponding desired. In addition, one or more clients may be located on 

to one of the n number of servers having a database repHca. ^^^^ 21O is, in some embodiments, a maipfpnTiP 

When any of the x data items in a database replica is updated computer system, a workstation, or a personal computer that 

OT copied from another server, the components of the daU- includes non-volatile storage device 225, such as magnetic 

base version vector associated with that database lepUca are ^ optical disks for data storage. The data being stored 

modified ^ropriately to indicate the number of additional |^ storage device 225 indudes data items which arc 

updates and on which server these updates were originally organized into one or more groups caUed databases, 

performed Referring back to HG. 1, a copy or replica of the same 

During a replication session between two of the n servers, database is stored in the memory of the servers located at 

tiie parotoool compares the database version vectws of the sites UO, 120, and 130. For the sake of brevity, servers 110, 

tworq)licas to detennine if update propagation is necessary. 120, and 130 refer to servers located at sites 10, 120, and 

If the database version vectors are not identical, then the 230, respectively. 

server possessing the more recent version of the data items cUcnts at the various sites provide users with an 

pxjpagates those data items to the server whose replica is ^ interface to conununicate with servers to read and update 

older using conventional update propagation techniques. items. An *^ipdate" refers to modification of one or 

Identical database version vectors indicate that update more data items at the request of a client When updates are 

propagation is not necessary. As such, the protocol avoids ^ ^^^^^ ^^^^ updates are propagated to other 

examining all data items in the database to determine the servers during a repUcation session to make all replicas 

necessity of update propagation, which is required in conr consistent with each other, in addition, a server may obtain 

ventional repUcation protocols. ^ more recent version of a data item via out-of-bonnd 

BRIEF DESCRimON OF THE DRAWINGS ^^^"8- '^"t^f-bound copjo^^^^ acquisition of 

a more recent version of a data item directly from another 

FIG. 1 is a simplified illustration of a conventional sorver outside the context of the normal replication proce- 

repiicated distributed system; so dure. Out-of-bound copying occurs when a user application 

FIG. 2 is an exemplary site within the distributed system requires the most recent version of a data item and tiiat it 

of pjQ, X' resides on another server. 

HG. 3 illustrates examples of updating version vectors; . In accordance w^ the invention, a protocol which effi- 

^_ . . , ... ^7; « J . u ciently detommes the necessity of update propagation is 

HO. 4 IS an exemplary illustration of a database version ^ ^^^^ propl^ation brtween the 

vector, source and recipient servers involves sending those data 

FIG. S is a flow diagram depicting the steps for perform- items or updates which are more current or newer in the 

ing update propagation; and source repUca to the recipient rq>lica. To dt^ermine tfie 

FIG. 6 illustrates an exanople of updating database version relative age of the copies of data items in the two replicas, 

vectors when version vectors are employed to represent eo version Information such as version vectors (Ws) are used. 

version information of data items. Before discussing the invention further, it will be useful to 

TMTTAiTxjn TMJcrfDTiynnxT provide a description of Ws. A detailed discussion of 

DETAILED DEJ>CRIFnON version vectors can be found in Pcpek ct aL, LOCUS: A 

The invention relates to a replicated distributed systenL In Network Transparent, High ReUabiUty Distributed System^ 

particular, the invention is directed to a protocol which 65 In Proc. 8th Symp. on Operating Systems Principles, pp. 

efficiently determines if update propagation between two 169-177 (1981), which is herein inooiporated by reference 

replicas of the same database is required Referring to FIG. for all purposes. 
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In general, a W comprises n oonq)oiients, each being 
assoditcd with one of tfie n number of servers that have a 
copy of the data item. Each con^)oncnt includes a numeric 
value reflecting the number of updates made by the corre- 
sponding server. In one embodiment, the W may be imple- 
mented with each con^nent being in the form of (sld, 
count), where sid is a server ID that conesponds to a server 
in the system, and count corresponds to the number of 
updates made by the server identified by sid. At 
initialization^ all count con^nents of the W are set to zera 
When a server receives an update request from a client to 
which it is coimected, the count in the con^onent corre- 
sponding to itself is incremented by 1 to reflect the update. 
However, if a server copies a data item from another server, 
via the update propagation or out-of-bound copying (which 
is pcrfomcd only if the source server's copy the date item 
has a W which is component- wise greater than cor equal to 
the W of the recipient scrvcr*s copy), the W is updated as 
follows: The counts in each component of the two Ws arc 
compared, and the larger count becomes the count for that 
component in the updated W. In alternative embodiments, 
the i* position of count in the W represents the i** server 
in the system where i is from 1 to n; n^2. 

Con^ying with the rules for maintaining Ws, the fol- 
lowing corollaries are true. First, if two copies of the same 
data item, Xj (residing on server 1) and X2 (residing on server 
2), have component-wise identical Ws, then these copies 
are identicaL Second, if the W component corresponding to 
server 3 for Xi (v^g) and (V23) is such that Vi3<V23 and 
V23-Vi3=Zj then Xj has seen 2 fewer updates performed by 
server 3. Furthermore, the missed updates are the last 
updates that server 3 applied to x^ (via update propagation 
Off oat-of-bound copying). And third, Xj is older than Xj if 
and only if a) x^'s VV is component-wise smaller or equal 
to Xj's W and b) at least one component of Xj's W is 
strictly less than the ccaresponding component of x^'s W. 

FIG. 3 is an illustrative example of how Ws associated 
with copies of a data item x are updated. As shown, servers 

1, 2, 3, and 4 eadi have a copy of x in their respective 
replica. VXi represents the W for the copy of x maintained 
on server 1, and Vxj represents the W for the copy of x on 
server 2. The W^s include four con^onents, cadi corre- 
sponding to a server. Vx^ shows that server I's copy of x has 
seen 5 updates from a client or clients connected to itself, 4 
updates on server 2, 0 updates on server 3, and 2 updates on 
server 4. The updates on servers 2 and 4 may have occurred 
on either update replication between the servers cr out-of- 
bound ccpying of x. VXj shows that server 2 received 2 
updates from server 1, 4 updates from its client(s), and 0 
updates from servers 3 and 4. Comparing the two Ws 
indicates that server l*s copy of x is more current than server 
2's copy because 1) cvciy component of Vxj is smaller or 
equal to the corresponding con^onent in Vxjt and 2) at least 
one component in Vxj is strictly less than the corresponding 
component in Vxi. Vx^"*'*' represents the W for server 2*s 
copy of X after it has been updated from server 1. F611owing 
the rules for updating Ws, the oonq>onent-wise maximum 
becomes the new count for that component As a result, the 
count corresponding to server 1, 2, 3, and 4 is 5, 4, 0, and 

2, respectively. Other conventional tedmiques, such as ver- 
sion numbers, are also useful to determine the version of a 
data item. 

Returning back to the description of the invention, a 
unique vector, refened to as a **database version vector^ 
(DBW) is associated with each database rq>lica in the 
system. Each DBW keeps track of the total nuinber of 
updates made to any data item in its respective database 
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repUca and on which server each update was cdginally 
pafonncd. Although the structure of DBWs is similar to 
Ws, the two types of vectors are quite differmt in nature. 
Ws are assodated with copies of individual data items 
5 while DBWs are associated with the rqjlicas of the entire 
database. This difference in granularity entails different 
properties of Ws and DBWs. For instance, identical Ws 
of different copies of the same data item reflect that the 
copies are identicaL However, this is not the case for 
DBWs. Since a DBW is assodated with the entire 
database, it refiects the total number of updates to the 
database, not to any specilic data item. As such, two replicas 
may have the same total number of updates pecfoimed by a 
given server but applied to different data items. This would 
result in the two non-identical replicas having identical 
DBWs. Furthermore, the comparison of the Ws of two 
different copies of the same data item determines the rda- 
tionship between these copies. For example, a copy of a data 
item is older than another if its W is con:^)onent-wise 
smaller or equal to the other copy's W and at least one 
20 conotponent of its W is strictly less than the corresponding 
component of other copy's W. In contmst, a con:q>arison of 
DBWs of a source and recipient database replicas does not 
ideatiiy their relationship. Even though the redpient repli- 
ca's DBW appears older (i.e., coir^nent wise smaller), 
25 than the source replica's DBW, it does not indicate that all 
data items in the redpient replica are older than those in the 
source replica. However, while DBWs appear to lack any 
substantive infcMination, they are effective in determining if 
update propagation between a source and redpient server is 
3Q necessary. 

In accordance with the invention, the DBWs of the 
source and recipient replicas are compared to determine if 
update propagation is necessary during scheduled r^lica- 
tion between a source server and a redpient server. If the 
35 replicas are identical, no update propagation is perfonned. 
If, on the other hand, the replicas are not identical, conven- 
tional tedmiques are used to propagate the updates to the 
redpient server. 
To daborate on how updates are tracked by eadi DBW, 
40 the following example is provided. Assume diat server 110 
applies an update to, for example, data item x in its replica. 
To indicate that the r^lica in server 110 has undergone one 
update, its DBW will be modified to show this additional 
update by server 110. Suppose that in a subsequent 
45 operation, server 110 copies a newer version of data item y 
from server 120, either during replication process betw^een it 
and server 120 or from an out-of-bound copying operation. 
Further, assume that the newer version of y, when compared 
to server 110*s old version, has 3 additional updates applied 
by server 120 and 2 additional updates af^lied by server 
130. This requires that in the DBW associated with the 
replica in server HO, the number of iipdates originally 
performed by server 120 and 130 be increased by 3 and 2, 
rcspcctivdy. 

As previously discussed, due to tiie coarse granularity of 
DBWs, non-identical database replicas may have identical 
DBWs, thus preventing more recent versions of data items 
from being propagated to the recipient server. For example, 
server 110 makes one update to data item x and data item y. 
Subsequently, server 120 copies x from server 110, and 
server 130 copies y from server 110. At this pomt, DB W^jo 
and DBW130 both rcflea one update from server 110, 
resulting in identical database version vectors. However, 
database replicas in server 120 and 130 are dearly not 
identicaL In this situation, (he update replication process 
between server 120 and 130 will not propagate any updates 
because both sorers have identical DBWs. 
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On the surface, this appears to be a problem associated 
with using DBVVs in replicated distributed systems. 
However, it can be shown that if replication is scheduled in 
such a way that every scxva cQmmunicates directly or 
indirectly with every other sever, this issue is resolved 5 
Using the above example, a replication schedule may 
include periodically performing replication between server 
110 and 120 and between 120 and 130. As such, the update 
to y in server 110 will be fffopagatcd to server 120 during 
replication between servers 110 and 120. DBW120 will be 
updated to reflect two updates from server 110. As a result, 
win show one more update irom server 110 than 
DBWi3o. This will cause the update to x to be prcpagated 
to server 130 during replication between servers 120 and 
130. Thus, scheduling replication such that all servers com- 
monicate direcdy or indirectly with each other ensures 
eventual propagadon of updates to all the replicas. Since 
conventional epidemic protocols also schedule replicatLon 
so that every server in the system communicates with each 
other directly or indirectly to ensure eventual propagation of 
updates to aU replicas, the above requirement for scheduling 
replication does not impose additional overhead or restric- 
tion on the system. 

Referring to FIG. 4, an illustratiYe embodiment of a 
DBW 400 is shown. The DBW contains N entries 25 
410rl04j^f* each ooiresponding to one of the N number of 
servers that maintain a database replica. Each entry, for 
example, is in the form of (SID, COUNT), where SID is a 
server ID that identliies a server in the systemi, and COUNT 
is an integer called the update count The update count 
Indicates the number of updates originating firom the server 
contained in SID. For example, when a server receives an 
update from a client which is connected to it, the server 
updates the COUNT value in the entry corresponding to 
itself. Other entries corresponding to other servers are 
updated accordingly when the server acquires updates from 
another server, either during replication procedure or by 
out-of-bound copying. In alternative embodiments, the i** 
position of count in the DBW can be used to ccsrespond to 
the i* server in the system. 

FIG. 5 is a flow diagram depicting the steps of the 
replication process between a source server and a recipient 
server in accordance with one embodiment of the invention. 
At step 510, the source or originating server sends an update 
replication request along with its database version vector 
(DBW^) to the recipient server. At step 520, the recipient 
server compares its database version vector (DBW^) to 
DB If DBW^ and DBW^. are not identical, Le., die 
count values of ooiresponding entries in both DBW^ and 
DB are not equal, then replication is necessary. As such, 
the server proceeds to step 530 where updates are propa- 
gated to the recipient server. Upon con^>letion of update 
propagation, the server terminates the replication process at 
stq> 540. If, on the otfier hand, DBW^ and DBW^ are 
identical, then the server proceeds to step 540 where the 
update replication process between the source and recipient 
servers tenninates. By comparing DBW„ widi DBW„ the 
recipient server can quickly determine whether updates are 
required without having to analyze each and every single 
data item in the database. 

The source server propagates updates to the rec^ient 
server using various conventional update propagation pro- 
tocols. One such protocol, for example, is employed in Lotus 
Notes. This protocol performs update propagation by com- 
paring version infonnation of data items in the source and 
recipient replicas and copying the newer version of those 
data items in their entirety from the source server's database 
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replica into the recipient server's database replica. Other 
update propagation protocols, such as the two-phase gossip 
protocol can also be used. A description of this protocol is 
provided in Heddaya, et al., Two-Phase Gossip: Managing 
Distributed Event Histories, Informational Science, VoL 49, 
pp. 35-57 (1989), herein incorporated by reference for all 
purposes. In general, the two-phase gossip protocol stores 
eadi update to a data item in a log as an update record. The 
update record contains sufGdent information to reconstruct 
the updated state of a data item given the version before the 
update. In addition, the update record contains the identity of 
the server that originally performed the update. During the 
replication session, these update records are then propagated 
to die recipient server as a stream of update records and each 
record is applied to the appropriate data items in the recipi- 
ent replica in the order they were ^plied in the source 
replica. Depending on whether coniplete data items or 
update records are propagated, different techniques for 
maintaining DBWs are employed. 

Maintenance of DBWs for protocols which propagate 
updates by copying data items in their entirety is as follows: 
When the system is initialized, all COUNT caiiq)onents of 
the DBWs arc set to 0. This reflects the fact that all 
database replicas are identical at initialization, thus identical 
DBWs. Anytime a server (SJ makes an update to any data 
item in its replica, the component of its DBW correspond- 
ing to Sg, is incremented. When S^ replaces its copy of a data 
item witti a newer version, either during update propagation 
or out-of-bound copying, the DBW is modified to reflect 
the extra updates acquired with the newer version of the data 
item 

FIG. 6 is an illustrative example showing how the DBW 
of a recipient server (DB WJ is modified when Ws are 
used to represent version information of data item. DB W^ 
includes n components (V, to corresponding to die n 
number of servers with a rq>lica of the same database. 
WXp) and Wx^^are the Ws associated with die originating 
and recipient servers 'copy of data item x, respectively. The 
Ws also include n number of components coiresponding to 
the n number cf servers having a copy of x. 

DBW^"*'*' reflects the modifications to DB W^ after x^ is 
copied to the recipient server's replica, either during repli- 
cation or out-of-bound copying. As shown, each DBW^ 
conqjonent is updated by adding the difference of the 
couesponding W component pair to it This rule for modi- 
fying each conq>onent of DBW^ can be formalized as 
follows: 

where Vj^'*^ is the modified con^nent of DBW, corre- 
sponding to kf* server, V/'' is the original component of 
DBW, coiresponding to server k, and v^ and v^ are 
respectively the components in the W of the originating and 
recipient servers'copy of x corresponding to server k. The 
difference of the W components (yokr-vrd resets the num- 
ber of additional updates made to the newer version of x by 
the server k. 

Maintenance of DBW in a system employing protocols 
which propagate updates as a stream of update records is as 
follows: When the system is initialized, all COUNT com- 
ponents of the DBWs are set to 0. This reflects the fact that 
all database repUcas are identical at initialization, thus 
identical DBWs. Anytime a server (S^) makes an update to 
any data item in its replica, its DBW is also modified to 
reflect that the replica has been updated. For updates at the 
request of a client, increments the DBW con^onent in 
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its DBW coirespondiiig to S^. If an update amved in the 5. The method of claim 4 wherein the replication session 

update record from another senrer, e.g., during update comprises the steps of: 

propa^tion,thcnthccomponcntinS„*s DBW correspond- drtcrmining vrtiether pnroagation of updates from flie 

ing to the se^er that arigimUy paformed the update is ^le first server to the database 

mcrei^nted. For example, S„ recerved an update r«onl 5 ^pUca of the second server is necessary; and 

firom S,, but the update was ongmaUy pcrfonned on Id ^ 

this case, the cair?>ODent in S^'s DBW coircsponding to S, prop^ating updates from the iirst database lepUca to the 

is incremented. second database replica if update propagation is deter- 

While the invention has been particularly shown and mined to be necessary, 

described with reference to various enabodiments, it wiU be ^- The method of claim 5 wherein the determining step 

recognized by those skilled in the art that modifications and comprises comparing the DB Ws associated with the first 

changes may be made to the present invention without replica with the second replica^ and wherein identical 

departing from the spirit and scope thereof. The scope of the DB Ws indicates that update propagation is not necessary 

invention should therefore be dctamined not with reference and non-identica] DBWs Indicates that update propagation 

to the above description but instead should be determined is necessary. 

with reference to the appended claims along with their full 7. The method ctf claim 6 wherein update propagation 

scope of equivalents. comprises sending more recent data items in the first replica 

The invention daimed is: ^ the second repHca. 

1. In a computer network comprising a pluraUty of servers x^e method of daim 7 wherein the data items that are 

andaplurahly of databaserq)Iicas co^ ^ detennined by comparing the version infor- 

data Items at least n datable replicas carrcspondu^ to n 20 ^ . ^ ^ fiiSreplica with the version 

number of servers, where n^2, and wherein each of the n '^11^^ iu„ ^^^^^ wiui lac vcrwon 

databasereplicascomprisesatleastxnumberofdataitems, information erf ^eoorr^^^ data items m the second 

whercxis^2, a methTd for operating the network including JfP^^^ ^« '^"^ w^'* ^ ^ ^ 

maintaining consistency among the x data items in the n ^^^^ rq)lica. 

replicas comprising: « ^' method of daim 8 wherein the version information 

associating va^ion information with die x data items in ^^ompiisQS version vectors, the version vectors coursing at 

each of the n repUcas, the version information record- ^ conqwnents corresponding to the n servers, each of 

ing the number of updates performed reflected on its ^® ? c<Mi^nents indicates the number of updates to the 

responsive data item copy and on which of the n servers version vector' s respective data item by the corresponding 

that the updates were originally performed; server. 

providing n database version vectors (DBWs), each The method of claim 9 wherein in response to 

corresponding to one of the n database replicas; receiving the more recent data items, the second server 

maintaining cadi of the n DBWs to indicate updates tiiat modifies the consents in its DBW to reflect any addi- 

were applied to any of die x data items in the DB W's ^^^al updates acquired as a result of the update from the first 

respective database replica and originally performed by 35 ^n whidi of the n servers that the additional 

the corresponding server, and updates were originally perfcmcd as follows: 

directly comparing the n DBWs to each other to make an 

initial threshold determination of whether any of the v'^=v^-hv -v vi^is 

data items in any of the DBWs have been recently * * n 1* 2*>. - " 

updated and thus require that a full comparison be 40 where V^^"'**' is the modified conq)onent of the second 
made at the data item level to determine whidi of the server's DBW corresponding to the k** servo:, V/" is the 
data items in each of the database replicas need updat- original con^wnent of the second server's DBW cone- 
ing in order to restore coniplete consistency among spending to the k* server, is the version vector corn- 
each of the data items in the n replicas. poncnt of the data item on the first server which carresponds 
2: The method of daim 1 wherein each of the DBWs 45 to die k* server, and V^j^ is the version vector component of 

compnscs at least 0 con^sonents which correspond to the n the data item on die second server which corresponds to the 

servers, eadi of the components indicates updates that are . jj** server. 

reflected in the DBW's respective database rcpUca and u, yhe mettiod of daim 6 wherein updates are stored as 

originaUy pcrf onned by the corresponding scrva. update records that contain information suffident to redo the 

3. The method of claim 2 whcrdn maintaining each of die 50 updateandtheidcntity of the server on whidi the update was 
DBWs comprises: originaUy perfomed. 

in response to a first one of n servers performing an 12. The method of claim 11 wherein update propagation 

update, modifying the DBW corresponding to the first comprises sending the update records from the first server to 

server by incrementing its component conresponding to the second &ervex, 

the first server to reflect die update; and 55 13. The method of daim 12 wherein die version infor- 

in response to the first server copying one ctf the x number mation comprises version vectors, the versiou vectors com- 

of data items frx>m a second one of n savers, modifying prising at least n con^Kmcnts conesponding to the n servers, 

the components of the DBW corresponding to the first each of the n conc^onents indicates Uic number of updates to 

server to reflect any additional updates acquired as a the version vector's respective data item by the correspond- 

result of the copying from the second server arid on 60 ing server. 

whidi of the n servers that the additional iqidates were 14. The method of daim 13 wherein the DBWs, in 

originally performed. response to receiving one of die update records from the first 

4. The method of daim 2 further comprises the st^ of server, the second server incronents the conqjonent in its 
sdieduHng a replication session between a first and a second DBW corresponding to the server on which the update was 
of the n servers for propagating updates to maintain oonsis- 6S originally pof onned. 

tency between the database r^licas of the first and second 

servers. m m ^ 
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